Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging
نویسندگان
چکیده
منابع مشابه
Parallel Approaches to Stochastic Global Optimization
In this paper we review parallel implementations of some stochas tic global optimization methods on MIMD computers Moreover we present a new parallel version of an Evolutionary Algorithm for global optimization where the inherent parallelism can be scaled to obtain a reasonable processor utilization For this algorithm the convergence to the global optimum with probability one can be assured Tes...
متن کاملParallel Approaches to Stochastic Global Optimization G Unter Rudolph
In this paper we review parallel implementations of some stochas-tic global optimization methods on MIMD computers. Moreover, we present a new parallel version of an Evolutionary Algorithm for global optimization, where the inherent parallelism can be scaled to obtain a reasonable processor utilization. For this algorithm the convergence to the global optimum with probability one can be assured...
متن کاملStochastic Global Optimization
Stochastic global optimization methods are methods for solving a global optimization problem incorporating probabilistic (stochastic) elements, either in the problem data (the objective function, the constraints, etc.), or in the algorithm itself, or in both. Global optimization is a very important part of applied mathematics and computer science. The importance of global optimization is primar...
متن کاملAutomatic termination of parallel optimization runs of stochastic global optimization methods in consensus or stagnation cases
Dynamic models give detailed information about the influence of many parameters on the behaviour of the biochemical process of interest. Parameter optimization of dynamic models is used in parameter estimation tasks and in design tasks. A drawback of the popular family of global stochastic optimization methods is the stochastic nature of the convergence of the best value of objective function t...
متن کاملStochastic Approximation with Averaging Innovation
The aim of the paper is to establish a convergence theorem for multi-dimensional stochastic approximation in a setting with innovations satisfying some averaging properties and to study some applications. The averaging assumptions allow us to unify the framework where the innovations are generated (to solve problems from Numerical Probability) and the one with exogenous innovations (market data...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Parallel and Distributed Systems
سال: 2020
ISSN: 1045-9219,1558-2183,2161-9883
DOI: 10.1109/tpds.2020.3040606